|
OpenStack Juno : Use Virtual Storages(GlusterFS)
2015/01/12 |
|
It's possible to use the Virtual Storage provided by Cinder
if an Instance needs more disks.
Configure Virtual storage with GlusterFS backend on here.
+------------------+ +------------------+
10.0.0.50| [ Storage Node ] | 10.0.0.61| |
+------------------+ +-----+ Cinder-Volume | +-----+ GlusterFS #1 |
| [ Control Node ] | | eth0| | | eth0| |
| Keystone |10.0.0.30 | +------------------+ | +------------------+
| Glance |------------+------------------------------+
| Nova API |eth0 | +------------------+ | +------------------+
| Cinder API | | eth0| [ Compute Node ] | | eth0| |
+------------------+ +-----+ Nova Compute | +-----+ GlusterFS #2 |
10.0.0.51| | 10.0.0.62| |
+------------------+ +------------------+
|
| [1] |
GlusterFS server is required to be running on your LAN.
This example uses a replication volume "vol_replica" provided by "gfs01" and "gfs02".
|
| [2] | Configure Storage Node. |
|
# install from EPEL
[root@storage ~]#
yum --enablerepo=epel -y install glusterfs glusterfs-fuse
[root@storage ~]#
vi /etc/cinder/cinder.conf # add follows in the [DEFAULT] section
volume_driver=cinder.volume.drivers.glusterfs.GlusterfsDriver
glusterfs_shares_config=/etc/cinder/glusterfs_shares glusterfs_mount_point_base=/var/lib/cinder/mnt
[root@storage ~]#
vi /etc/cinder/glusterfs_shares # create new : specify GlusterFS volumes gfs01.srv.world:/vol_replica chmod 640 /etc/cinder/glusterfs_shares [root@storage ~]# chgrp cinder /etc/cinder/glusterfs_shares [root@storage ~]# mkdir /var/lib/cinder/mnt [root@storage ~]# chown cinder. /var/lib/cinder/mnt [root@storage ~]# systemctl restart openstack-cinder-volume |
| [3] | Configure Compute Node to mount GlusterFS volume. |
|
# install from EPEL
[root@node01 ~]#
yum --enablerepo=epel -y install glusterfs glusterfs-fuse
[root@node01 ~]#
vi /etc/nova/nova.conf # add follows in the [DEFAULT] section volume_drivers="glusterfs=nova.virt.libvirt.volume.LibvirtGlusterfsVolumeDriver" systemctl restart openstack-nova-compute |
| [4] | For example, create a virtual disk "disk01" with 10GB. It's OK to work on any node. (This example is on Control Node) |
|
[root@dlp ~(keystone)]# cinder create --display_name disk01 10
+---------------------+--------------------------------------+
| Property | Value |
+---------------------+--------------------------------------+
| attachments | [] |
| availability_zone | nova |
| bootable | false |
| created_at | 2015-01-12T13:47:42.608332 |
| display_description | None |
| display_name | disk01 |
| encrypted | False |
| id | edd2f68d-327b-41cd-966c-e46833a9309c |
| metadata | {} |
| size | 10 |
| snapshot_id | None |
| source_volid | None |
| status | creating |
| volume_type | None |
+---------------------+--------------------------------------+
[root@dlp ~(keystone)]# cinder list +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ | ID | Status | Display Name | Size | Volume Type | Bootable | Attached to | +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ | edd2f68d-327b-41cd-966c-e46833a9309c | available | disk01 | 10 | None | false | | +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+ |
| [5] | Attach the virtual disk to an Instance. For the exmaple below, the disk is connected as "/dev/vdb". It's possible to use it as a storage to create a file system on it. |
|
[root@dlp ~(keystone)]# nova list +-----------+-----------+---------+------------+-------------+-----------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +-----------+-----------+---------+------------+-------------+-----------------------------------+ | df11d64d- | CentOS_70 | SHUTOFF | - | Shutdown | int_net=192.168.100.6, 10.0.0.201 | +-----------+-----------+---------+------------+-------------+-----------------------------------+[root@dlp ~(keystone)]# nova volume-attach CentOS_70 edd2f68d-327b-41cd-966c-e46833a9309c auto +----------+--------------------------------------+ | Property | Value | +----------+--------------------------------------+ | device | /dev/vdb | | id | edd2f68d-327b-41cd-966c-e46833a9309c | | serverId | df11d64d-dd72-4d1a-bf0a-5cd764c2f863 | | volumeId | edd2f68d-327b-41cd-966c-e46833a9309c | +----------+--------------------------------------+ # the status of attached disk turns "in-use" like follows [root@dlp ~(keystone)]# cinder list +--------------------------------------+--------+--------------+------+-------------+----------+--------------------------------------+ | ID | Status | Display Name | Size | Volume Type | Bootable | Attached to | +--------------------------------------+--------+--------------+------+-------------+----------+--------------------------------------+ | edd2f68d-327b-41cd-966c-e46833a9309c | in-use | disk01 | 10 | None | false | df11d64d-dd72-4d1a-bf0a-5cd764c2f863 | +--------------------------------------+--------+--------------+------+-------------+----------+--------------------------------------+ |